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Abstract — In this paper, we present a method to estimate the 
quality (trustfulness) of the solutions of the classical optimal 
data association (DA) problem associated with a given source of 
information (also called a criterion). We also present a method to 
solve the multi-criteria DA problem and to estimate the quality of 
its solution. Our approach is new and mixes classical algorithms 
(typically Murty’s approach coupled with Auction) for the search 
of the best and the second best DA solutions, and belief functions 
(BF) with PCR6 (Proportional Conflict Redistribution rule # 
6) combination rule drawn from DSmT (Dezert-Smarandache 
Theory) to establish the quality matrix of the global optimal 
DA solution. In order to take into account the importances of 
criteria in the fusion process, we use weighting factors which 
can be derived by different manners (ad-hoc choice, quality of 
each local DA solution, or inspired by Saaty’s Analytic Hierarchy 
Process (AHP)). A simple complete example is provided to show 
how our method works and for helping the reader to verify by 
him or herself the validity of our results. 

Index Terms — Data association, Multi-criteria analysis, belief 
functions, PCR6, DSmT. 



I. Introduction 

Efficient algorithms for modern multisensor-multitarget 
tracking (MS-MTT) systems [ 1 ] , [2] require to estimate and 
predict the states (position, velocity, etc) of the targets evolving 
in the surveillance area covered by a set of sensors. These 
estimation and prediction are based on sensors measurements 
and dynamical models assumptions. In the monosensor con- 
text. MTT requires classically to solve the data association 
(DA) problem to associate the available measurements at a 
given time with the predicted states of the targets to update 
their tracks using filtering techniques (Kalman filter. Particle 
filter, etc). In the multisensor MTT context, we need to solve 
more difficult multi-dimensional assignment problems under 
constraints. Fortunately, efficient algorithms have been devel- 
oped in the operational research and tracking communities for 
formalizing and solving these optimal assignments problems 
(see the related references detailed in the sequel). 

Before going further, it is necessary to recall briefly the basis 
of DA problem and the methods to solve it. This problem 
can be formulated as follows: We have m > 1 targets T) 
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(i = 1, . . . , m), and rz > 1 measurements 1 Zj ( j = 1, . . . , n) 
at a given time k, and a m x n rewards (gain/payoff) matrix 
ft = whose elements ui(i,j) > 0 represent the 

payoff (usually homogeneous to the likelihood) of the asso- 
ciation of target T, with measurement z 3 , denoted ( T i: Zj ). 
The data association problem consists in finding the global 
optimal assignment of the targets with some measurements by 
maximizing 2 the overall gain in such a way that no more than 
one target is assigned to a measurement, and reciprocally. 

Without loss of generality, we can assume > 0 

because if some elements of ft were negative, we 

can always add the constant value 3 to all elements of ft to 
work with a new payoff matrix ft' = [ui'(i,j)] having all 
elements > 0, and we get same optimal assignment 

solution with ft and with ft'. Moreover, we can also assume 
without loss of generality m < n because otherwise we can 
always swap the roles of targets and measurements in the 
mathematical problem definition by working directly with ft 4 
instead, where the superscript t denotes the transposition of the 
matrix. The optimal assignment problem consists of finding 
the m x n binary association matrix A = [a(i,j)) which 
Maximize the global rewards 

m n 

i?(ft, A) = j)a(i, j) (1) 

*= 1 3 = 1 

(E”=i a[i,j) = l = 

Subject to <| YT= t a (h j) < 1 (i = 1, • ■ . , n) (2) 

e {0, 1} 

The association indicator value a(i,j) = 1 means that 
the corresponding target T) and measurement z 3 are asso- 
ciated, and a(i,j ) = 0 means that they are not associated 
(* = 1, . . . , m and j = 1, . . . , n). 

! In a multi-sensor context targets can be replaced by tracks provided by 
a given tracker associated with a type of sensor, and measurements can be 
replaced by another tracks set. In dilferent contexts, possible equivalents are 
assigning personnel to jobs or assigning delivery trucks to locations. 

2 In some problems, the matrix ft = [co(i, j)] represents a cost matrix 
whose elements are the negative log-likelihood of association hypotheses. In 
this case, the data association problems consists in finding the best assignment 
that minimizes the overall cost. 

3 equals to the absolute value of the minimum of ft. 
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The solution of the optimal assignment problem stated in 
(l)-(2) is well reported in the literature and several efficient 
methods have been developed in the operational research 
and tracking communities to solve it. The most well-known 
algorithms are Kuhn-Munkres (or Hungarian) algorithm [3], 
[4] and its extension to rectangular matrices proposed by 
Bourgeois and Lassalle in [5], Jonker-Volgenant method[6], 
and Auction [7], More sophisticated methods using Murty’s 
method [8], and some variants [9], [10], [1 1], [12], [13], [14], 
[15], are also able to provide not only the best assignment, but 
also the m-best assignments. We will not present in details all 
these classical methods because they have been already well 
reported in the literature [16], [17]. 

The purpose of this paper is to propose a solution for 
two important problems related with the aforementioned Data 
Association issue: 

• Problem 1 (mono-criterion): Suppose that the DA reward 
fii has been established based on a unique criterion C\ then 
we want to evaluate the quality 4 of each association (pairing) 
provided in the optimal solution by one of the aforementioned 
algorithms. The choice of the algorithm does not matter as 
soon as they are able to provide the optimal DA solution 
represented by a binary matrix Ai (assumed to be unique 
here for convenience). So based on fli and Aj, we want to 
estimate the quality matrix Qi of the optimal pairing solutions 
given in Aj. This quality matrix will be useful to select 
optimal association pairings that have sufficient quality to be 
used to update the tracking filters, and not to use the optimal 
data associations that have a poor quality, which will save 
computational time and avoid to potentially degrade tracking 
performances. 

• Problem 2 (multi-criteria): We assume that we have 
different Rewards matrices fii, . . . , FIk ( K > 1), established 
from different criteria from which we can draw optimal DA 
solutions Ai , . . . , Ak with their corresponding quality ma- 
trices Qi, . . . , Qx (obtained by the method used for solving 
Problem 1). We assume that each criterion Ck, k = 1 , ,K 
has its own importance with respect to the others which is 
expressed either by a given relative importance K x K matrix 
M, or directly by a weighting M x 1 vector w. The problem 
2 consists in finding the optimal (i.e. the one generating the 
best global quality) DA solution based on all information 
drawn from the independent multiple criteria we have, that 
is from Qi, ..., and M (or w) in a well-justified and 
comprehensive manner. 

This paper is organized as follows: in section 2 we present 
a method for solving problem 1 which uses both 1 st-best and 
2nd-best DA solutions provided by Murty’s algorithm. Our 
method is based on Belief Functions (BF), the Proportional 
Conflict Redistribution fusion rule #6 (PCR6) developed in 
Dezert-Smarandache Theory (DSmT) framework [19], and the 
pignistic probability transform. Section 3, proposes a solution 
for Problem 2 exploiting Saaty’s AHP method, BF and also 

4 In this paper, the quality of a pairing of the optimal DA solution refers to 
a confidence score which corresponds to a degree of trustfulness one grants 
to this pairing for taking the decision to use it, or not. 



Murty’s algorithm. Section 4 presents a full simple detailed 
example to show how the method works for readers who want 
to check by themselves our results. Section 5 will conclude 
this paper with perspectives. 

II. Solution of problem 1 (mono-criterion) 

This solution has already been addressed in details in [21] 
and we will just briefly present here the main ideas for making 
this paper self containing. In problem 1 , we want to establish 
a confidence level (i.e. a quality indicator) of the pairings of 
the optimal data association solution. More precisely, we are 
searching for an answer to the question: how to measure the 
quality of the pairings a(i 7 j ) = 1 provided in the optimal 
assignment solution A? The necessity to establish a quality 
indicator is motivated by the following three main practical 
reasons: 

1) In some practical tracking environment with the 

presence of clutter, some association decisions 
(a(i,j) = 1) are doubtful. For these unreliable 

associations, it is better to wait for new information 
(measurements) instead of applying the hard data 
association decision, and making potentially serious 
association mistakes. 

2) In some multisensor systems, it can be also important 
to save energy consumption for preserving a high 
autonomy of the system. For this goal, only the most 
trustful specific associations provided in the optimal 
assignment have to be used instead of all of them. 

3) The best optimal assignment solution is not necessarily 
unique. In such situation, the establishment of quality 
indicators may help in selecting one particular optimal 
assignment solution among multiple possible choices. 



It is worth noting that the lst-best, as well as the 2nd-best, 
optimal assignment solutions are unfortunately not necessarily 
unique. Therefore, we need to take into account the possible 
multiplicity of assignments in the analysis of the problem. The 
multiplicity index of the best optimal assignment solution is 
denoted /3 1 > 1, and the multiplicity index of the 2nd-best 
optimal assignment solution is denoted /3 2 > 1, and we will 
denote the sets of corresponding assignment matrices by A\ = 
{A< fcl) , h = 1 ...,/?!} and by A 2 = {A< fe) , k 2 = 1 . . . , ft}. 
Here are three simple examples with different multiplicities in 
solutions: 



1 2 
[5 3 3^ 

/? 2 = 1 because the 1 st best and 2nd best 



Example 1: If we take fi = 



, then /?i = 2 and 
DA solutions are 



, ki— 1 



1 

0 



0 

1 



0 

0 



A i=2 



1 

0 



0 

0 




0 0 1 
10 0 ' 



Example 2: If we take T2 = 



6 3 9 
1 4 1 



then (3\ = 1 and 



02 = 2 because the 1 st best and 2nd best DA solutions are 



Ai 



0 0 
0 1 



1 

0 



! A 



k 2 =l 

2 



1 o 
o 1 



0 

0 



, k-2—2 



0 0 1 
10 0 ' 
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ri 2 3 

|_4 5 6 

/3 2 = 2 because the 1 st best and 2nd best DA solutions are 



Example 3: If we take O = 



, then /?i = 2 and 



fci=i 



,fcl=2 



m s (A) = o 8 (*,j) ■w(i,j)/R a (Q, A s 
m s (X U -A) = 1 — m s (A) 



(3) 



Applying the conjunctive fusion rule (here one has no con- 
flicting mass), we get 



0 


0 


1 




0 


1 


0 


’ 


0 


0 


1' 




1 


0 


0 





m( X) = mi(A)m 2 (A) + mi(A)m 2 (A U -A) 
+mi(X U -A)m 2 (A) 



(4) 



To establish the quality of the specific associations (pairings) 
(i,j) satisfying oi (i,j) = 1 belonging to the optimal as- 
signment matrix Ai, we propose to use both Ai and 2nd- 
best assignment solution A 2 . The basic idea is to use the 
values oi (i,j) = 1 in the best, and a 2 (i,j) in the 2nd-best 
assignments to identify the change (if any) of the optimal 
pairing In fact, we assume 5 that higher quality of an 

entry in a quality matrix suggests that its association in an 
optimal solution is more stable across those good solutions. 
The connection between the stability of an association across 
the good solutions and the stability over an error in measure- 
ment is done through the components of the reward matrices 
(the inputs of our method) which must take into account 
the measurement uncertainties. Based on this assumption, our 
quality indicator will be defined using both the stability of 
the pairing and its relative impact in the global reward. This 
proposed method works also when the 2nd-best assignment 
solution A 2 is not unique (as shown in examples 2 and 3). 
Our method helps to select the best (most trustful) optimal 
assignment in case of multiplicity of Ai matrices. We do 
not claim that the definition of the quality matrix proposed 
in this work is the best proposal. However, we propose a new 
comprehensive way of solving this problem from a practical 
standpoint. 

To take into account efficiently the reward values of each 
specific association given in the best assignment Ai and in 
the 2nd-best assignment A^ 2 for estimating the quality of 
DA solutions, we propose to use the following construction 
of quality indicators depending on the type of matching: 

• When ai (i,j) = a k = 0, one has full agreement 
on “non-association” ( T t ,Zj ) in Ai and in A(j 2 and this 
non-association (7j, zj) has no impact on the global rewards 

Ai) and f? 2 (fl, A k2 ), and it will be useless. Therefore, 
we can set its quality arbitrarily to any arbitrary value, typi- 
cally we take q k2 (i,j) = 0 because these values are not useful 
at all for the application (i.e. tracking) standpoint. 

• When ai (i,j) = a 2 2 (*,j) = 1, one has a full agreement 
on the association (T.;. zj) in Ai and in A^ 2 . his association 
(' Ti,Zj ) has however different impacts in the global rewards 
values f?i(D,Ai) and f?. 2 (fi, A\ 2 ). To qualify the quality 
of this association (Tj, zj), we define the two basic belief 
assignments (BBA’s) on X = ( T t ,Zj ) and X U -A (the 
ignorance), for s = 1, 2 as follows: 



Applying the pignistic transformation 6 [20], we get finally 
BetP(X) = m{X) + ± • m(A U -.A) and BetP(-iX) = 
| m(X U -A). Therefore, we choose as quality indicator 
for the association (71; . Zj) the value q k2 (i,j) = BetP(X) = 
m(A) + i ■ m(A U -iX). 

• When ai (i,j) = 1 and a k 2 (2,7) = 0, one has a dis- 
agreement (conflict) on the association (71;, zj) in Ai and in 
(Tj, zj 2 ) in A?j 2 , where j 2 is the measurement index such that 
02(2,72) = 1. To qualify the quality of this non-matching 
association ( Ti,Zj ), we define the two following basic belief 
assignments (BBA’s) of the propositions X = ( Ti,Zj ) and 
Y±(Ti,z ja ) 






and 



mi (A) = ai (i,j) ■ 
mi (A U Y) = 1 - mi (A) 



m 2 (Y) - a 2 (»,j 2 ) ■ 
m 2 (X U V) = 1 — m 2 (Y) 



(5) 



(6) 



Applying the conjunctive fusion rule, we get m(Afl Y = 0) = 
mi(A)m 2 (Y) and 



m( A) = mi(X)m 2 (X U Y) 
m(Y) = mi(AU Y)m 2 (Y) 
m(X U Y) = mi (A U Y)m 2 ( A U Y) 



(7) 



5 This assumption has however not been proven formally yet and its validity 
is a challenging open-question left for future research works. 



Because we need to work with a normalized combined BBA, 
we can choose different rules of combination (say either 
Dempster-Shafer’s rule, Dubois- Prade’s rule. Yager’s rule [19], 
etc). In this work, we propose to use the Proportional Conflict 
Redistribution rule no. 6 (PCR6) proposed originally in DSmT 
framework [19] because it has been proved very efficient in 
practice [28], [29]. Hence with PCR6, we get: 

'm(A) = mi(A)m 2 (A U Y) + m,( A) • Z\x)+^) 
m(Y) = mi (A U Y)m 2 (Y) + m 2 ( X) • "$^(2) 
m(A U Y) = mi (A U Y)m 2 (A U Y) 

( 8 ) 

Applying the pignistic probability transformation, we get 
finally BetP(X) = m(A) + \ • m( A U Y) and BetP(Y ) = 
m(Y) + | • m( A U Y). Therefore, we choose the quality 
indicators as follows: q k2 (i,j) = BetP(X), and q fc 2 (i,j 2 ) = 
BetP(Y). 

6 We have chosen here BetP for its simplicity and because it is widely 
known, but DSmP could be used instead for expecting better performances 
[ 19 ]. 
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The absolute quality factor Q a bs{ Aj) of the optimal as- 
signment given in Ai conditioned by A 2 2 , for any fc 2 € 
{1,2,..., /3 2 } is defined as 

m n 

Q abs (A 1 ,A!% 2 ) = EE ai(hj)Q k2 (iJ) (9) 

i= 1 J=1 

The absolute average quality factor Q aV er( Ai) per associ- 
ation of the optimal assignment given in Ai conditioned by 
A 2 2 , for any fc 2 € {1,2,..., /3 2 } is defined by 



tracks, we do not need to pay attention (compute and store) 
the qualities of components (i,j) such that = 0. In 

fact all components (i,j) such that ai (i,j) = 0 should be set 
to zero by default in Q matrix. 

Example 4: Let’s consider the rewards matrix 





' 1 


11 


45 


30' 


T2 = 


17 


8 


38 


27 




10 


14 


35 


20 



Q awr (A 1 ,A^) = -Q obs (A 1 ,A^) (10) 

m 

where m is the number of ”1” in the optimal DA matrix Ai 
(i.e. the number of targets). 

To take into account the eventual multiplicities (when 
/? 2 > 1) of the 2nd-best assignment solutions A 2 2 , k 2 = 
1,2, ...,/3 2 , we need to combine the Q/(Ai,A 2 2 ) values. 
Several methods can be used for this, in particular we can use 
either: 

- A weighted averaging approach: The quality indicator 
components q(i,j) of the quality matrix Q are then obtained 
by averaging the qualities obtained from each comparison of 
Ai with A 2 2 . More precisely, one will take 

02 

9(*>i)-E w ( A 2 2 )9 fc2 (*’i) C 11 ) 

k 2 = l 

where w( A 2 2 ) is a weighting factor in [0,1], such that 
Y2kl=i w (A 2 2 ) = 1. Since all assignments A 2 2 have the same 
global reward value R 2 , then we suggest to take u;(A 2 2 ) = 
l//3 2 . A more elaborate method would consist of using the 
quality indicator of A 2 2 based on the 3rd-best solution, which 
can be itself computed from the quality of the 3rd assignment 
solution based on the 4th-best solution, and so on by a similar 
mechanism. 

- A belief-based approach: (see [18] for basics on belief 

functions): A second method would express the quality by 
a belief interval [q min (i,j), g max (i, ji)] in [0,1] instead of 
single real number in [0,1]. More precisely, one can 

compute the belief and plausibility bounds of the quality 
by taking q min (i,j) = Bel(ai(i,j)) = min k 2 q k2 {i,j) and 
g max (j, j) = Pl(ai(i, j)) = maxj, 2 q k2 (i,j). Hence for each 
possible pair (i, j), one can define a basic belief assignment 
(BBA) rriij{.) on the frame of discernment 0 = {T = 
trustful, -iT = not trustful}, which characterizes the quality 
of the pairing (i,j) in the optimal assignment solution Ai, as 
follows 

= g min (i, j) 

< m^T) = l-g max (i,j) (12) 

rriij(T U -<T) = g max (i, j) ~ q min {i,j ) 

Because only the optimal associations 7 (i,j) such that 
ai(i, j) = 1 are useful in tracking algorithms to update the 

7 given in the optimal solution found using Murty’s algorithm. 



We get one 1st best (/3i = 1) and four 2nd best (/3 2 = 4) 
DA solutions with their respective qualities as follows: 



Ai = 



0 0 10 
0 0 0 1 
0 10 0 



f?i(fi,Ai) =86 



0 0 0 1 ' 
0 0 10 
0 10 0 



Q(A 1; A 2 2=1 ) 



R 2 {fl, A* 2 " 1 ) =82 



0 0 

0 0 

0 0.65 



0.59 0 

0 0.41 

0 0 



0 0 1 O' 
10 0 0 
0 0 0 1 



Q(Ai, A: 



k 2 =2 \ 



R 2 (n, A* 2=3 ) =82 



0 0 0.89 0 

0 0 0 0.56 

0 0.45 0 0 



1 k 2 =3 



0 0 10 ' 
0 0 0 1 
10 0 0 



Q(Ai, A: 



k 2 =3\ 



R 2 (n, A* 2=3 ) =82 



0 0 0.89 0 

0 0 0 0.76 

0 0.52 0 0 



\k 2 =4 



Q(A 1; a 2 2=4 ) 



0 0 0 1 
10 0 0 
0 0 10 

. fc 2 =4'| 



R 2 (n, A* 2=1 ) =82 



0 0 0.59 0 

0 0 0 0.56 

0 0.35 0 0 



Note that the absolute quality factors are : 

Q abs (A 1 ,A^ 2=1 ) « 1.66, Qabs(Ai, A 2 2=2 ) 
Q abs ( At, A^ 2=3 ) « 2.19, Q abs ( Ar, A^' 2=4 ) 

Therefore, we can see that 



1.91 

1.51 



QabsiM, A£ 2 - 3 ) > <5o6s(A 1 , A 2 2-2 ) 

> Qabs( Ar, A^ 2=1 ) > Q abs ( A l5 A^ 2 = 4 ) 

which makes perfectly sense because Ay has more matching 
pairings with A 2 2-3 than with others 2nd-best assignments 
A 2 2 (fc 2 3). These pairings have also the strongest impact 
in the global reward value. Therefore, the quality matrix Q 
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differentiates the quality of each pairing in the optimal assign- 
ment Ai as expected. This method provides an effective and 
comprehensive solution to estimate the quality of each specific 
association provided in the optimal assignment solution Ai. 
The averaged qualities per association are: 

Q aver ( A!,A^ 2=1 ) «0.55, Q aver ( A!,A^= 2 ) «0.63 

Qo^AlA^ 3 ) wO.73, Q aver ( A^A^^O.hO 



The global quality matrix is then given by (using the 
averaging approach) 



Q(Ai, A2) 



1 

S E Q(A„A*-) 

k 2 =l 

'0 0 0.74 0 ' 

0 0 0 0.57 

0 0.49 0 0 



The global quality indexes Q a 6 s (Ai, A2) and 
Q a „ er (Ai, A 2 ) are then approximately equal to 1.8 and 
0.6 respectively. 



One can also improve the estimation of the quality matrix by 
using the absolute quality factor of each solution Q(Ai, Aj 2 ), 
for k 2 = 1 , . . . /?2 to define the normalized weighting factors 
as follows: 

w = [ Wk 2 ,k 2 = 1, . ..p 2 y 

with Wk 2 — Q abs ( J ^}’ A z ) ( and where the normalization factor 
K is given by K = Y*kl=i Qabs{A 1, A?j 2 ). In this example, 
we get the weights 

. 1.66 1.91 2.19 1.51 , 

V,= [ W1W2 W 3 W,} 

= [0.2283 0.2627 0.3012 0.2077]' 



The global quality matrix is then given by (using the 
averaging approach) 



Q(A l5 A 2 ) 



f>2 

Y Wfc 2 Q(Ai, Aj 2 ) 
k 2 = l 

'0 0 0.76 0 ' 

0 0 0 0.58 

0 0.49 0 0 



If we prefer to use the Belief Interval Measure (BIM) 
instead of the previous averaging approach, we will get in 
this example the following imprecise qualities values: 



Optimal, assignments 


BIM 


(T3) 


« [0.59,0.89] 


(2,4) 


ss [0.41,0.76] 


(3,2) 


S3 [0.35, 0.65] 



Based on the comparisons of (pessimistic) lower bounds, 
or (optimistic) upper bounds of BIM, we observe that we get 
a consistent ordering of the qualities of the optimal solutions 
(same ordering as with the averaging method). 



III. Solution of the 2nd problem (multi-criteria) 

In this section, we evaluate the global DA association 
solution, with estimation of its quality, based on the 
knowledge of the qualities of multiple optimal DA solutions 
established separately based on distinct association criteria 
Cfc, k = 1, ... ,K. More precisely, given the set of quality 
matrices Q k ( k = 1,...,K) defined by the components 
q k (i,j) according to Eq.(ll), how to establish the global 
optimal DA solution with its overall quality matrix Q? 
Moreover, we want to take into account the importance 
of each criteria (when defined) in the establishment of the 
solution. 



In fact this 2nd problem is linked to the previous one and 
the method developed for solving our first problem will also 
help to solve this second problem as it will be shown in the 
following. Our solution is based on four distinct steps: 

• Step 1 : Estimation of the normalized weighting vector w of 
the criteria: Two simple approaches are proposed to establish 
the normalized criteria ranking (weighting) vector. 



1 ) Direct method: The weightings factors can be directly 
established either by an external source of information, 
or by the system designer. If these weightings factors 
are not available, we propose to compute them from 
the qualities indicators derived by the method used to 
solve the 1st problem (see the previous section). For 
example, if we consider K criteria providing quality 
factors Q k bs (A 1 (C k ),A 2 {C k )), k = 1,2 ,...,K, then 
we compute the normalized K x 1 weighting vector 
w = [wi W 2 -..wk]' with the fc-th component given by 

... a Q k abs (M(Ck),A 2 (C k )) 

UJk — /,• ( 1 - 5 ) 

HUQL s (M(C j ),A 2 (C j )) 

where Q k bs (Ai(Ck), A 2 {Ck)) is the absolute quality 
factor obtained from the quality matrix Q fc (Ai, A 2 ) of 
the optimal DA for the criteria Ck- 

2) Saaty’s method: This method is part of Saaty’s AHP 
method widely used for multi-criteria decision analysis 
in operational research [22], [23], [24], and it has been 
connected with information fusion and belief functions 
in [25], [26], [27]. The relative importance of one 
criterion over another must be expressed by the system 
designer using a pairwise K x K comparison matrix 
(also called knowledge matrix) M = [m pq ] where 
the element m pq of the matrix defines the importance 
of criteria C v with respect to the criteria C q , with 
p,q € {1,2,..., K}. For example, see [25] for details, 
let’s consider only K = 3 criteria, if the comparison 
matrix is given by 



M = 



(1/1) (1/3) (4/1)' 
(3/1) (1/1) (5/1) 

(1/4) (1/5) (1/1) 



it means that the element m.13 = 4/1 indicates that the 
criteria C\ is four times as important as the criteria C3 
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for the system designer (or decision-maker), etc. From 



this pairwise matrix, Saaty demonstrated that the ranking 




"87 


35 


43 


20 


95 


of the priorities of the criteria can be obtained from the 


n(c 2 ) = 


28 


83 


25 


10 


29 


normalized eigenvector, denoted w, associated with the 




10 


7 


72 


41 


29 


principal/max eigenvalue of the matrix M, denoted A. 














In our example, one gets A = 3.0857 and and w = 




"25 


78 


49 


60 
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[0.2797 0.6267 0.0936]' which shows that C 2 criterion is 


n(c 3 ) = 


30 


26 


79 


20 


49 


the most important criterion with the weight 0 .6267 , then 


20 


20 
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47 


81 


the criterion C\ is the second most important criterion 















with weight 0.2797, and finally C 3 criterion is the least 
important criterion with weight 0.0936. 

• Step 2: Combined estimation of the qualities of each target 
association 

Once the normalized weighting vector w of the criteria 
has been obtained, we need at first to compute the com- 
bined/weighted estimation of the qualities of each target 
association with the n available measurements. This is done 
by building the following n x K matrix 



Q, 4 [q^C'i) . . . q i(C K )\ 



(14) 



where each column qi(Cjfc) of the matrix Qi corresponds to 
the transpose of the i-th row of the quality matrix Q fc (Ai, A 2 ). 

Then following AHP approach, we multiply this n x K 
matrix Qj by the normalized criteria ranking K x 1 vector 
w (obtained either from the direct method of Saaty’s one) to 
get the combined estimation of the qualities of each target 
association. More precisely, for the i-th target, we obtain the 
following nxl vector 



- Q 2 w 



(15) 



• Step 3: Search for the optimal global assignment based on 
combined qualities derived from the criteria. 

From the set of m vectors q, (i=l,2,. . . ,m) we need to solve 
now a new optimal DA association problem with the (global) 
7 Ti x n rewards matrix defined by 



= [qi Q2 • • ■ q n 



(16) 



Murty’s algorithm is then used again here to get the optimal 
DA solution(s) providing the best global reward, and to 
generate also all the 2 nd-best solutions that are necessary to 
estimate its quality in Step 4. 

• Step 4: Estimation of the quality of the optimal DA solution. 

We use the method described in Section 2 for solving the 
problem 1 to estimate the quality of the optimal DA solution. 
If several lst-best DA solutions occur, we choose the solution 
generating the highest Q a bs quality index. 

IV. A SIMPLE ILLUSTRATIVE EXAMPLE 
For the sake of simplicity, let’s consider the following 
example with m = 3 targets, n = 5 measurements, and 3 
criteria C \ , C 2 and C 3 associated with the (randomly chosen) 
rewards matrices: 



n(Ci) = 
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27 
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80 


25 


37 
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38 
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78 
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A. Qualities of optimal data associations 

Applying the method described in section 1 . we easily 
obtain the following quality matrices of optimal DA solutions: 

• For criterion C\, one gets = 1 and /?2 = 1 , and the 
following 1 st best and 2nd best DA solutions 



n(Ci 



providing the 1 st and 2 nd best global rewards 
i?(fi(Ci),Ai) = 258 and R{Q(Ci), A 2 ) = 240. Ap- 
plying the method described in Section 2, we obtain the 
following quality matrix related with the optimal DA 
based on criterion C\. 



' 


"l 


0 


0 


0 


0 " 


> 

II 
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0 
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0 




"l 
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0 " 


A 2 = 
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0 


0 


0 


1 




1 

0 


0 


0 


1 


0 1 



Q 1 



0.82 0 0 0 0 

0 0.52 0 0 0 

0 0 0 0.76 0 



For criterion C 2 , one gets /3i = 1 and fl 2 = 1, and the 
following 1st best and 2nd best DA solutions 



n{c 2 



providing the 1 st and 2 nd best global rewards 
R{n(C 2 ), Ai) = 250 and R(ft(C 2 ), A 2 ) = 242. Ap- 
plying the method described in Section 2, we obtain the 
following quality matrix related with the optimal DA 
based on criterion C 2 : 
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II 
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0 




"1 
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A2 = 
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0 


0 




0 


0 


1 


0 


0 1 



Q 



0 0 0 0 0.51 

0 0.78 0 0 0 

0 0 0.74 0 0 



For criterion C 3 , one gets /3\ = 1 and T 2 — 1 , and the 
following 1st best and 2nd best DA solutions 
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n(c 3 ) 
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providing the 1st and 2nd best global rewards 
R(il{C 3 ), Ai) = 238 and R(Sl{C 3 ), A 2 ) = 220. Ap- 
plying the method described in Section 2, we obtain the 
following quality matrix related with the optimal DA 
based on criterion C 3 : 



Q 3 



0 0.53 0 0 0 

0 0 0.78 0 0 

0 0 0 0 0.79 



B. Multicriteria-based DA solution with its quality 

• Case 1: If we assume that all criteria have the same 
weights in the search of optimal DA solution, then 
we take the normalized weighting vector as w = 
[1/3 1/3 1/3]'. Therefore, the weighted average fl G = 
J2k=i w kQ k of the quality matrices Q 1 , Q 2 and Q 3 
gives us the following rewards matrix 



n G 



0.27 0.17 0 0 0.17 

0 0.43 0.26 0 0 

0 0 0.25 0.25 0.26 



Now we solve the DA association problem to maximize 
the global quality reward using Murty’s algorithm and we 
get the following 1st best and 2nd best DA solutions: 





'1 


0 


0 


0 


o' 


Ai = 


0 


1 


0 


0 


0 




0 


0 


0 


0 


1 




'1 


0 


0 


0 


0 " 


A 2 = 


0 


1 


0 


0 


0 




0 


0 


0 


1 


0 



with the 1st and 2nd best global rewards R(fl G , Ai) ~ 
0.97 and R(fl G , A 2 ) ~ 0.96. Applying the method 
described in Section II to estimate the quality of this 
optimal DA solution, we obtain the following quality 
matrix: 



Q 



0.74 0 0 0 0 

0 0.84 0 0 0 

0 0 0 0 0.50 



• Case 2: If we use the prior information given by abso- 
lute quality indicators to build the normalized weighting 
vector, we get 

m n 
i= 1 3=1 



<&. = ££q 2 (m)« 2 - 04 

i= 1 3=1 



Q 



3 . 

abs 



m n 



Q 3 (*’■?) 

i= 1 3=1 



2.10 



and we have Ql bs + Ql bs + Ql bs = 6.2672. So that, the 
normalized weights are given by 



W = [iCl W2 W3]' 



2.1154 2.0426 2.1091 , 
6.2672 6.2672 6.2672^ 
[0.3375 0.3260 0.3365]' 



The weighted average f l G = w kQ k of the quality 

matrices Q 1 , Q 2 and Q 3 give us now the following 
rewards matrix 



fio 



0.27 0.17 0 0 0.16 

0 0.43 0.26 0 0 

0 0 0.24 0.25 0.26 



Now we solve the DA association problem to maximize 
the global quality reward and we get the following 1st 
best and 2nd best DA solutions: 
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with the 1st and 2nd best global rewards R(fl G , Ai) « 
0.97 and R(fl G , A 2 ) ~ 0.96. Applying the method 
described in Section 2 to estimate the quality of this 
optimal DA solution, we obtain the following quality 
matrix: 



Q 



0.74 0 0 0 0 

0 0.84 0 0 0 

0 0 0 0 0.50 



Because the normalized weights based on the absolute 
quality indicators, in this example, are all close to 1/3, 
we obtain the result of the multicriteria-based optimal DA 
and its quality close to what we get when assuming equi- 
importance of the criteria in the fusion process, which is 
normal. 

To qualify qualitatively the quality of the pairings in the 
optimal DA solution, we split the quality range [0; 1 ] into three 
subintervals as follows 8 



Low quality : 
Medium quality : 
High quality : 



if e [0; 1/3] 
if q(i,j) e [1/3; 2/3] 
if q(i,j) e [2/3; 1] 



8 Of course, other repartitions could be used instead depending on the what 
would prefer the system designer. 
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Based on this qualitative scale, we finally get for our 
example the final multicriteria-based DA solution 



A! 



1 0 0 0 0 
0 10 0 0 
0 0 0 0 1 



with the qualitative quality matrix 



q qualitative 



High 



High — — 



Medium 



where the notation ” means “that the quality evaluation 
does not apply”, or is interpreted (by default) as “the worst 
quality”. 



Remark: It is worth to note that this approach provides in 
general not the same results as if one would combine (and 
weight) directly the original reward matrices of each criterion. 
In this example, the weighted global reward matrix indirect = 
J2k=i w k^l{Ck) would be equal to 



n 



direct 



69.07 

22.93 

23.13 



45.39 

61.43 

9.98 



41.75 

44.46 

30.78 



29.31 

22.79 

55.75 



40.85 

47.44 

53.53 



corresponding to the quality matrix of optimal DA solution 



Qdirect 



0.73 0 0 0 0 

0 0.84 0 0 0 

0 0 0 0.47 0 



One sees that these high quality solutions are fully consis- 
tent with the high quality solutions of our method. However, 
the medium quality solution (we get (3,4) pairing from the 
direct optimal assignment versus (3,5) assignment obtained by 
our method) mismatch. This reflects an ambiguity in the choice 
of the assignment of target T 3 . Therefore, such assignment is 
unreliable because of its low quality, and should not be used 
to update the track of this target. 



V. Conclusion 

In this paper, we have proposed two methods based on belief 
functions for establishing: 1 ) the quality of pairings given 
by optimal data association (or assignment) solution using a 
chosen algorithm (typically Murty’s algorithm coupled with 
Auction algorithm) with respect to a given criterion, and 2) 
the quality of the multicriteria-based optimal data association 
solution. Our methods are independent of the choice of the 
algorithm used in finding the optimal assignment solution, and, 
in case of multiple optimal solutions, they provide also a way 
to select the best optimal assignment solution (the one having 
the highest absolute quality factor). The methods developed 
in this paper are general in the sense that they can be applied 
to different types of association problems corresponding to 
different sets of constraints. This method can be extended to 
SD-assignment problems as well. As perspectives, we would 
like to extend our approach to the n-D assignment context, 
and then evaluate its performances in a realistic multi-target 
tracking scenario. 
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